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Abstract 

In contrast with software-generated randomness (called pseudo-randomness), quantum random- 
ness is provable incomputable, i.e. it is not exactly reproducible by any algorithm. We provide 
experimental evidence of incomputability — an asymptotic property — of quantum randomness 
by performing finite tests of randomness inspired by algorithmic information theory. 
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I. QUANTUM INDETERMINACY 



US 



The irreducible indeterminacy of individual quantum processes postulated by Born [lH3| 
implies that there exist physical "oracles," which are capable to effectively produce outputs 
which are incomputable. Indeed, quantum indeterminism has been proved [4] under some 
"reasonable" side assumptions implied by Bell-, Kochen-Specker- and Greenberger-Horne- 
Zeilinger-type theorems. Yet, as quantum indeterminism is nowhere formally specified, it 
is important to investigate which (classes of) measurements lead to randomness, what are 
the reasons for possible distinctions, whether or not the kinds of randomness "emerging" 
in different classes of quantum measurements are "the same" or "different," and what are 
the phenomenologies or signatures of these randomness classes. Questions about "degrees of 
(algorithmic) randomness" are studied in algorithmic information theory. Here are just four 
types, among an infinity of others: (i) standard pseudo-randomness produced by software 
like Mathematica or Maple which are not only Turing computable but cyclic; (ii) pseudo- 
randomness produced by software which is Turing computable but not cyclic (e.g., digits of tt, 
the ratio between the circumference and the diameter of an ideal circle, or Champernowne's 
constant): (iii) Turing incomputable, but not algorithmically random; (iv) algorithmically 
random 5kZ(]. One can ask: in which of these four classes do we find quantum randomness? 
Operationally, in the extreme form, Born's postulate could be interpreted to allow for the 
production of "random" finite strings; hence quantum randomness could be of type (iv). 
(Here the quotation mark refers to the fact that randomness for finite strings is too "sub- 
jective" to be meaningful for our analysis. The legitimacy of the experimental approach 



comes from characterizations o 



ibility of their finite prefixes. js _ 2|-) A sequence which is not algorithmically random but 
Turing incomputable can, for instance, be obtained from an algorithmically random se- 
quence X1X2 ■ ■ ■ x n ■ ■ ■ by inserting a in between any adjacent original bits, i.e. obtaining 
the sequence 21O22O ■ • • 0x n ■ ■ ■ This transformation destroys algorithmic randomness be- 
cause obvious correlations have appeared; Turing incomputability is invariant under this 
transformation because a copy of the original sequence is embedded in the new one. Yet 
much more subtler correlations among subsequences of Turing incomputable sequences may 
exist, thus making them compressible and algorithmically nonrandom. There is no a priori 
reason to interpret Born's indeterminism by its strongest formal expression; i.e., in terms of 



random sequences in terms of the degrees of incompress- 



algorithmic randomness. 

Quantum randomness produced by quantum systems which have no classical interpre- 
tation is provable \^\ Turing incomputable. More precisely, if the experiment would run 
under ideal conditions "to infinity," the resulting infinite sequence of bits would be Turing 
incomputable; i.e., no Turing machine (or algorithm) could reproduce exactly this infinite 
sequence of digits. This result has many consequence; here is one example. The experiment 
could produce a billion of Os, but not all bits produced will be 0. A stronger form of in- 
computability holds true: every Turing machine (or algorithm) can reproduce exactly only 
finitely many scattered digits of that infinite sequence. Yet this proof stops short of showing 
that the sequence produced by such a quantum experiment is algorithmically random; i.e., 
it is unknown whether or not such a sequence is or is not algorithmically random. One of 
the strategies toward answering this question is to empirically perform tests "against" the 
algorithmic randomness hypothesis. 

Our (more modest) aim is to present tests capable of distinguishing computable from 
incomputable sources of "randomness" by examining (long, but) finite prefixes of infinite 
sequences. Such differences are guaranteed to exist by [4j, but, because computability is an 
asymptotic property, there was no guarantee that finite tests can "pick" differences in the 
prefixes we have analyzed. 



II. TESTS OF EXPERIMENTAL QUANTUM INDETERMINACY 

Based on Born's postulate, several quantum random number generators based on beam 
splitters have recently been proposed and realized 8Ml5j . In what follows a detailed analysis 
of bit strings of length 2 32 obtained by two such quantum random number generators will 
be presented — the first analysis of a set of quantum bits of this size (the size correlates 
well with the square root of the cycle length used by cyclic pseudo-random generators; 
randomness properties of longer strings generated in this way are impaired). We will compare 
the performance of quantum random number generators with software-generated number 
generators on randomness inspired by algorithmic information theory (which complement 
some commonly used statistical tests implemented in "batteries" of test suites such as, 
for instance, diehard [if]], NIST 17], or TestUOl [isj]). The standard test suites are often 



based on tests which are not designed for physical random number generators, but rather to 



quantify the quality of the cyclic pseudo-random numbers generated by algorithms. As we 
would like to separate "truly" random sequences from software-generated random sequences, 
the emphasis is on the former type of tests. 

The tests based on algorithmic information theory directly analyze randomness, and 
thus the strongest possible form of incomputability. They differ from tests employed in 
the standard randomness batteries as they depend on irreducible algorithmic information 
content, which is constant for algorithmic pseudo-random sequences. Some tests are related 
to each other, as for instance sequences which are not Borel normal (cf. below) could be 
algorithmically compressed; the analysis of results helps understanding subtle differences 
at the edge of incomputability/algorithmic randomness. All tests depend on the size of 
the analyzed strings; the legitimacy of our approach is given by the fact that algorithmic 
randomness of an infinite sequence can be "uniformly read" in its prefixes (cf. [3]). 



III. DATA SOURCES 



The analyzed quantum data consist of 10 quantum random strings generated with the 



commercially available Quantis device 



19| . based on research of a group in Geneva [ill ]. 



as well as 10 quantum random strings generated by the Vienna IQOQI group 20j. The 



pseudo-random data consist of 10 pseudo-random strings produced by Mathematica 6 [21] . 



and 10 pseudo-random strings produced by Maple 11 



221 ]. as well as 10 strings of 2 32 bits 



from the binary expansion of ir obtained from the University of Tokyo's supercomputing 



center [23 ]. 



The signals of the Quantis device are generated by a light emitting diode producing 
photons which are then transmitted toward a beam splitter (a semi-transparent mirror) and 
two successive single-photon detectors (detectors with single-photon resolution) to record 
the outcomes associated with the symbols "0" and "1," respectively [19|. Due to hardware 
imbalances which are difficult to overcome at this level, Quantis processes this raw data by 
un-biasing the sequence by a von Neumann type normalization: The biased raw sequence 
of zeroes and ones is partitioned into fixed subsequences of length two; then the even parity 
sequences "00" and "11" are discarded, and only the odd parity ones "01" and "10" are 
kept. In a second step, the remaining sequences are mapped into the single symbols 01 i — ^- 
and 10 i — y 1 , thereby extracting a new unbiased sequence at the cost of a loss of original 



bits Q, p. 768]. 

This normalization method requires that the events are (temporally) uncorrelated and 
thus independent. (For the sake of a simple counterexample, the von Neumann normalization 
of the sequences 010101 • • ■ or 1100110011 ■ ■ ■ are the constant-0 sequence 000 ■ • • and the 
empty sequence.) Under the independence hypothesis, the normalized sequences are Borel 
normal [25 1; e.g., all finite subsequences of length n occur with their expected asymptotic 
frequencies 2~ n . (Alas, see 26j for some pitfalls when transforming such sequences.) 

The signals of the Vienna Institute for Quantum Optics and Quantum Information 
(IQOQI) group were generated with photons from a weak blue LED light source which 
impinged on a beam splitter without any polarization sensitivity with two output ports as- 
sociated with the codes "0" and "1," respectively [lOj]. There was no pre- or post-processing 
of the raw data stream, in particular no von Neumann normalization as discussed for the 
Quantis device; however the output was constantly monitored (the exact method is subject 
to a patent pending). In very general terms, the setup needs to be running for at least one 
day to reach a stable operation. There is a regulation mechanism which keeps track of the 
bias between "0" and "1," and tunes the random generator for perfect symmetry. Each data 
file was created in one continuous run of the device lasting over hours. 

We have employed the extended cellular automaton generator default of Mathematica 6's 
pseudo-random function. It is based on a particular five-neighbor rule, so each new cell 
depends on five nonadjacent cells from the previous step [211 ] . Maple 11 uses a Mersenne 



Twister algorithm to generate a random pseudo-random output 



221. 



IV. TESTING INCOMPUTABILITY AND RANDOMNESS 

The tests we performed can be grouped into: (i) two tests based on algorithmic infor- 
mation theory, (ii) statistical tests involving frequency counts (Borel normality test), (iii) a 
test based on Shannon's information theory, and (iv) a test based on random walks. 

In Figures dHS] the graphical representation of the results is rendered in terms of box- 
and-whisker plots, which characterize groups of numerical data through five characteristic 
summaries: test minimum value, first quantile (representing one fourth of the test data), 
median or second quantile (representing half of the test data), third quantile (representing 
three fourths of the test data), and test maximum value. Mean and standard deviation of the 
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data representing the results of the tests are calculated. Tables containing the experimental 
data and the programs used to generate the data can be downloaded from our extended 
paper [27]. 



A. Book stack randomness test 



28 



is based on the fact that 



The book stack (also known as "move to front") test 
compressibility is a symptom of less randomness. 

The results, presented in Figured] and Tabled! are derived from the original count, the 
count after the application of the transformation, and the difference. The key metric for this 
test is the count of ones after the transformation. The book stack encoder does not compress 
data but instead rewrites each byte with its index (from the top/front) with respect to its 
input characters being stacked/moved-to- front. Thus, if a lot of repetitions occur (i.e., a 
symptom of non-randomness), then the output contains more zeros than ones due to the 
sequence of indices generally being smaller numerically. 
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FIG. 1. (Color online) Box-and- whisker plot for the results of the "book stack" randomness test. 
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TABLE I. Statistics for the results of the "book stack" randomness test. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 7964 34490 49220 69630 108700 53410 33068.58 

Mathematica 4508 13020 24110 43450 62570 27940 19406.03 
Quantis 28600 60480 87780 106700 156100 89990 41545.76 

Vienna 9110 38420 57720 73220 97660 53860 27938.92 

vr 8551 35480 42100 52870 78410 41280 20758.46 



B. Solovay-Strassen probabilistic primality test 

The second algorithmic test, based on the Solovay-Strassen probabilistic primality test, 
uses Carmichael (composite) numbers which are "difficult" to factor, to determine the quality 
of randomness b y c omputing how fast the probabilistic primality test reaches the verdict 
"composite" 0, 



32 



33]. 



31] . All Carmichael numbers less than 10 16 have been used 

To test whether a positive integer n is prime, we take k natural numbers uniformly 
distributed between 1 and n — 1, inclusive, and, for each one i, check whether the predicate 
W(i, n) holds. If this is the case we say that u i is a witness of n's compositeness" . If W(i, n) 
holds for at least one i then n is composite; otherwise, the test is inconclusive, but in this 
case if one declares n to be prime then the probability to be wrong is smaller than 2~ k . 

This is due to the fact that at least half z's from 1 to n — 1 satisfy W(i, n) if n is indeed 
composite, and none of them satisfy W{i, n) if n is prime [30]. Selecting k natural numbers 
between 1 and rz — 1 is the same as choosing a binary string s of length n — 1 with k l's 
such that the ith bit is 1 iff i is selected. Ref. [3l| contains a proof that, if s is a long 
enough algorithmically random binary string, then n is prime iff Z(s, n) is true, where Z is 



a predicate constructed directly from conjunctions of negations of W [34 1. 

A Carmichael number is a composite positive integer k satisfying the congruence b k ~ l = 
l(modfc) for all integers b relative prime to k. Carmichael numbers are composite, but are 
difficult to factorize and thus are "very similar" to primes; they are sometimes called pseudo- 
primes. Carmichael numbers can fool Fermat's primality test, but less the Solovay-Strassen 



test. With increasing values, Carmichael numbers become "rare" 



35). 



The fourth test uses Solovay-Strassen probabilistic primality test for Carmichael numbers 
(composite) with prefixes of the sample strings as the binary string s. We used the Solovay- 
Strassen test for all Carmichael numbers less than 10 16 — computed in Ref. (32], 33] — with 
numbers selected according to increasing prefixes of each sample string till the algorithm 
returns a non-primality verdict. The metric is given by the length of the sample used to 
reach the correct verdict of non-primality for all of the 246683 Carmichael numbers less than 
10 16 . [We started with k — 1 tests (per each Carmichael number) and increase k until the 
metric goal is met; as k increases we always use new bits (never recycle) from the sample 
source strings.] The results are presented in Figure |5] and Table ITT] 
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FIG. 2. (Color online) Box- and- whisker plot for the results based on the Solovay-Strassen proba- 
bilistic primality test. 



C. Borel normality test 

Borel normality — requesting that every binary string appears in the sequence with the 
correct probability 2~ n for a string of length n — served as the first mathematical definition of 
randomness [25[ . A sequence is (Borel) normal if every binary string appears in the sequence 
with the right probability (which is 2~ n for a string of length n). A sequence is normal if and 
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TABLE II. Statistics for the results based on the Solovay-Strassen probabilistic primality test. 



Descriptive statistics 


min Ql 


median 


Q3 max 


mean sd 


Maple 


93.0 96.0 


101.0 


113.5 120.0 


104.9 10.57723 


Mathematica 


93.0 97.0 


109.0 


132.3 142.0 


113.5 19.60867 


Quantis 


99.0 103.3 


113.0 


121.3 130.0 


112.6 10.66875 


Vienna 


82.0 100.3 


104.5 


109.0 119.0 


103.5 11.03781 


7T 


84.0 91.75 


106.0 


110.8 128.0 


104.7 10.66875 



only it is incompressible by any information lossless finite-state compressor [36]], so normal 
sequences are those sequences that appear random to any finite-state machine. 

Every algorithmic random infinite sequence is Borel normal [37J. The converse implication 
is not true: there exist computable normal sequences (e.g., Champernowne's constant). 

Normality is invariant under finite variations: adding, removing, or changing a finite 
number of bits in any normal sequence leaves it normal. Further, if a sequence satisfies the 
normality condition for strings of length n + 1, then it also satisfies normality for strings of 
length n, but the converse is not true. 

Normality was transposed to strings in Ref . 37J ■ In this process one has to replace limits 



with inequalities. As a consequence, the above two properties, which are valid for sequences, 
are no longer true for strings. 

For any fixed integer m > 1, consider the alphabet B m = {0, l} m consisting of all binary 
strings of length m, and for every 1 < i < 2 m denote by N™ the number of occurrences of the 
lexicographical zth binary string of length m in the string x (considered over the alphabet 
B m ). By \x\ m we denote the length of x. A string x is Borel normal if for every natural 
1 < m < log 2 log 2 \x\, 



N™{x) 



\x\ 



< 





,2 


x\ 




X 





for every 1 < j < 2 m . In Ref. 37J it is shown that almost all algorithmic random strings are 
Borel normal. 

In the first test we count the maximum, minimum and difference of non-overlapping 
occurrences of m-bit (m = 1,...,5) strings in each sample string. Then we tested the 



Borel normality property for each sample string and found that almost all strings pass the 
test, with some notable exceptions. We found that several of the Vienna sequences failed 
the expected count range for m = 2 and a few of the Vienna sequences were outside the 
expected range for m = 3 and m = 4 (some less then the expected minimum count and some 
more than the expected maximum count). The only other bit sequence that was outside 
the expected range count was one of the Mathematica sequences that had a too big of a 
count for k — 1. Figure [3] depicts a box-and-whisker plot of the results. This is followed by 
statistical (numerical) details in Table IIHI 
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FIG. 3. (Color online) Box-and-whisker plot for the results for tests of the Borel normality property. 
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D. Test based on Shannon's information theory 



The next test computes "sliding window" estimations of the Shannon entropy L\ , . . . , L l n 
according to the method described in 38] : a smaller entropy is a symptom of less random- 



ness. The results are presented in Figure 0] and Table IPVl 
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TABLE III. Statistics for the results for tests of the Borel normality property. 

Descriptive statistics min Ql median Q3 max mean sd 

Maple 22430 47170 61990 76130 94510 60210 21933.52 

Mathematica 8572 25500 40590 55650 86430 41870 23229.77 
Quantis 146800 185100 210500 226600 260000 207200 33515.65 

Vienna 77410 340200 350500 392500 260000 337100 103354.3 

vr 14260 28860 40880 47860 79030 40220 17906.21 
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FIG. 4. (Color online) Box-and-whisker plot for average results in "sliding window" estimations of 
the Shannon entropy. 

E. Test based on random walks 

A symptom of non-randomness of a string is detected when the plot generated by viewing 
a sample sequence as a ID random walk meanders "less away" from the starting point (both 
ways); hence the max- min range is the metric. 

The fifth test is thus based on viewing a random sequence as a one- dimensional random 
walk; whereby the successive bits, associated with an increase of one unit per bit of the 
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TABLE IV. Statistics for average results in "sliding window" estimations of the Shannon entropy. 

Descriptive statistics min Ql median Q3 max mean sd 

Maple 0.9772 0.9781 0.9784 0.9787 0.9788 0.9783 0.0005231617 

Mathematica 0.9776 0.9781 0.9783 0.9785 0.9800 0.9783 0.0006654936 
Quantis 0.9779 0.9783 0.9783 0.9786 0.9795 0.9784 0.0004522699 

Vienna 0.9772 0.9777 0.9784 0.9790 0.9792 0.9783 0.0006955834 

vr 0.9779 0.9784 0.9788 0.9790 0.9799 0.9788 0.0006062724 



re-coordinate, are interpreted as follows: 1 ="move up," and ="move down" on the y-axis. 
In this way a measure is obtained for how far away one can reach from the starting point (in 
either positive or negative) from the starting y- value of that one can reach using successive 
bits of the sample sequence. Figure [5] and Table |V] summarize the results. 
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FIG. 5. (Color online) Box-and-whisker plot for the results of the random walk tests. 
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TABLE V. Statistics for the results of the random walk tests. 



Descriptive statistics min Ql median Q3 max mean sd 

Maple 67640 88730 126400 162500 180500 125300 42995.59 

Mathematica 73500 84760 98110 103400 120300 96450 14685.34 
Quantis 138200 161600 209000 250200 294200 211300 55960.23 

Vienna 92070 130200 155600 167600 226900 152900 36717.55 

vr 58570 70420 82800 91920 107500 82120 14833.75 



V. STATISTICAL ANALYSIS OF RANDOMNESS TESTS RESULTS 



In what follows the significance of results corresponding to each randomness test applied 
to all five sources have been analyzed by means of some statistical comparison tests. The 

rn 

Kolmogorov-Smirnov test for two samples [39] determines if two datasets differ significantly. 
This test has the advantage of making no prior assumption about the distribution of data; 
i.e., it is non-parametric and distribution free. 

The Kolmogorov-Smirnov test returns a p-value, and the decision "the difference between 
the two datasets is statistically significant" is accepted if the p-value is less than 0.05; or, 
stated pointedly, if the probability of taking a wrong decision is less than 0.05. Exact 
p- values are only available for the two-sided two-sample tests with no ties. 

In some cases we have tried to double-check the decision "no significant differences be- 
tween the datasets" at the price of a supplementary, plausible distribution assumption. 



Therefore, we have performed the Shapiro- Wilk test for normality [40j and, if normality is 
not rejected, we have assumed that the datasets have normal (Gaussian) distributions. In 
order to be able to compare the expected values (means) of the two samples, the Welch 



i-test |41|, which is a version of Student's test, has been applied. In order to emphasize the 
relevance of p-values less than 0.05 associated with Kolmogorov-Smirnov, Shapiro- Wilk and 
Welch's t-tests, they are printed in boldface and discussed in the text. 
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TABLE VI. Kolmogorov-Smirnov test for the "book-stack" tests. 



Kolmogorov-Smirnov test p-values Mathematica Quantis Vienna tt 

Maple 0.4175 0.1678 0.9945 0.4175 

Mathematica 0.0021 0.1678 0.4175 

Quantis 0.1678 0.0123 

Vienna 0.4175 



TABLE VII. Shapiro- Wilk test for the "book-stack" tests. 



Shapiro- Wilk test Maple Mathematica Quantis Vienna tt 
p-value 0.7880 0.4819 0.7239 0.8146 0.5172 



A. Book stack randomness test 



The results of the Kolmogorov-Smirnov test associated with the "book-stack" tests are 
enumerated in Table I VI I Statistically significant differences are identified for Quantis versus 
Mathematica and tt. 

As more compression is a symptom of less randomness, the corresponding ranking of 
samples is as follows: (Quantis) = 89988.9 > (Vienna) = 53863.8 > (Maple) = 53411.6 > 
(tt) = 41277.5 > (Mathematica) = 27938.3. The Shapiro- Wilk tests results are presented in 
Table IvTIl 

Since normality is not rejected for any string, we apply the Welch's t-test for the compar- 
ison of means. The results are enumerated in Table IVIIII Significant differences between the 
means are identified for the following sources: (i) Quantis versus all other sources (Maple, 
Mathematica, Vienna, tt); and (ii) Vienna versus Mathematica and Maple (as already men- 
tioned). 
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TABLE VIII. Welch's i-test for the "book-stack" tests. 



p-value Mathematica Quantis Vienna ir 



Maple 0.0535 
Mathematica 
Quantis 
Vienna 



0.0436 0.974 0.3412 
0.0009 0.0283 0.1551 
0.0368 0.0054 

0.2690 



TABLE IX. Kolmogorov-Smirnov test for the Solovay-Strassen tests. 

Kolmogorov-Smirnov test ^-values Mathematica Quantis Vienna ir 

Maple 0.7591 0.4005 0.7591 0.7591 

Mathematica 0.7591 0.7591 0.7591 

Quantis 0.4005 0.7591 

Vienna 0.9883 



B. Solovay-Strassen probabilistic primality test 

The Kolmogorov-Smirnov test results for this test are presented in Table \IX\ where no 
significant differences are detected. 

The Shapiro- Wilk test results are presented in Table [X] Since there is no clear pattern 
of normality for the data, the application of Welch's i-test is not appropriate. 

C. Borel test of normality 

The results of the Kolmogorov-Smirnov test are presented in Table IXIl Statistically 

TABLE X. Shapiro- Wilk test for the Solovay-Strassen tests. 

Shapiro- Wilk test Maple Mathematica Quantis Vienna tt 
p-value 0.0696 0.0363 0.4378 0.6963 0.4315 
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TABLE XI. Kolmogorov-Smirnov test for the Borel normality tests. 



Kolmogorov-Smirnov test p-values Mathematica Quantis Vienna it 

Maple 0.4175 < 10 4 0.0002 0.1678 

Mathematica < 10 4 0.0002 0.9945 

Quantis 0.0002 < 10 -4 

Vienna 0.0002 



significant differences are identified for (i) Quantis versus Maple, Maple, Mathematica and 
7r; (ii) Vienna versus Maple, Mathematica and 7r; and (iii) Quantis versus Vienna. 
Note that 

1. Pseudo-random strings pass the Borel normality test for comparable, relatively small 
(with respect to quantum strings; cf. below), numbers of counts: if the angle 
brackets (x) stand for the statistical mean of tests on x, then (Maple) = 60210, 
(Mathematica) = 41870, (tt) = 40220). 

2. Quantum strings pass the Borel normality test only for "much larger numbers" of 
counts ((Quantis) = 207200, (Vienna) = 337100). 

As a result, the Borel normality test detects and identifies statistically significantly differ- 
ences between all pairs of computable and incomputable sources of "randomness." 

D. Test based on Shannon's information theory 

The results of the Kolmogorov-Smirnov test are presented in Table IXHI No significant 
differences are detected. The descriptive statistics data for the results of this test indicates 
almost identical distributions corresponding to the five sources. 

The results of the Shapiro- Wilk test associated with a test based on Shannon's informa- 
tion theory are presented in Table IXIIII Since there is no clear pattern of normality for the 
data, the application of Welch's t-test is not appropriate. 
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TABLE XII. Kolmogorov-Smirnov test for Shannon's information theory tests. 



Kolmogorov-Smirnov test p-values Mathematica Quantis Vienna n 

Maple 0.7870 0.7870 0.7870 0.1678 

Mathematica 0.7870 0.4175 0.0525 

Quantis 0.4175 0.1678 

Vienna 0.4175 



TABLE XIII. Shapiro- Wilk test for Shannon's information theory tests. 

Shapiro- Wilk test Maple Mathematica Quantis Vienna n 
p-value 0.1962 0.0189 0.0345 0.3790 0.8774 



E. Test based on random walks 

The Kolmogorov-Smirnov test results associated with test based on random walks are 
presented in Table IXIVl Statistically significant differences are identified for: (i) Quantis 
versus all other sources (Maple, Mathematica, Vienna and 7r); (ii) Vienna versus Mathe- 
matica, Vienna (as already mentioned) and 7r; and (hi) Maple versus n. 

Quantum strings move farther away from the starting point than the pseudo-random 
strings; i.e., (Quantis) > (Vienna) > (Maple) > (Mathematica) > (it). 

Note that quantum strings move farther away from the starting point than the pseudo- 

TABLE XIV. Kolmogorov-Smirnov test for the random walk tests. 
Kolmogorov-Smirnov test p-values Mathematica Quantis Vienna it 



Mathematica 0.1678 0.0123 0.4175 0.0525 

Quantis < 10 4 0.0021 0.1678 

Vienna 0.0525 < 10 4 

vr 0.0002 
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TABLE XV. Shapiro- Wilk test for the random walk tests. 



Shapiro- Wilk test Maple Mathematica Quantis Vienna tt 
p-value 0.2006 0.9268 0.5464 0.8888 0.9577 



TABLE XVI. Welch's t-tests for the random walk tests. 

p-value Mathematica Quantis Vienna it 
Maple 0.06961 0.0013 0.1409 0.0119 

Mathematica < 10 4 0.0007 0.0435 

Quantis 0.0143 < 10 4 

Vienna 0.0001 



random strings; i.e., (Quantis) > (Vienna) > (Maple) > (Mathematica) > (n). It was 
quite natural to double-check the conclusion "Quantis and Vienna do not exhibit significant 
differences." Hence we run the Shapiro- Wilk test, which concludes that normality is not 
rejected; cf. Table IXVl 

Next, we apply the Welch's t-test for the comparison of means. The results are given 
in Table IX VI I Significant differences between the means are identified for the following 
sources: (i) Quantis versus all other sources (Maple, Quantis, Vienna, 7r); (ii) Vienna versus 
Mathematica), Quantis (as already mentioned) and 7r; (hi) Maple versus n. 

VI. SUMMARY 

Tests based on algorithmic information theory analyze algorithmic randomness, the 
strongest possible form of incomputability. In this respect they differ from tests employed 
in the standard test batteries, as the former depend on irreducible algorithmic informa- 
tion content, which is constant for algorithmic pseudo-random generators. Thus the set of 
randomness tests performed for our analysis could in principle be expected to be "more sen- 
sitive" with respect to differentiating between quantum randomness and algorithmic types 
of "quasi-randomness" than statistical tests alone. 
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All tests have produced evidence — with different degrees of statistical significance — of 
differences between quantum and non-quantum sources. In summary: 



1. For the test for Borel normality — the strongest discriminator test — statistically 
significant differences between the distributions of datasets are identified for (i) Quantis 
versus Maple, Mathematica and n; (ii) Vienna versus Maple, Mathematica and 7r; and 
(iii) Quantis versus Vienna. 

Not only that the average number of counts is larger for quantum sources, but the 
increase is quite significant: Quantis is 3.5 — 5 times larger than the corresponding 
average number of counts for software-generated sources, and Vienna is 5 — 8 times 
larger than those values. 

2. For the test based on random walks, statistically significant differences between the 
distributions of datasets are identified for: (i) Quantis versus all other sources (Maple, 
Mathematica, Vienna and 7r); (ii) Vienna versus Mathematica, Vienna and n. Quan- 
tum strings move farther away from the starting point than the pseudo-random strings; 
i.e., (Quantis) > (Vienna) > (Maple) > (Mathematica) > (n). 

3. For the "book-stack" test, significant differences between the means are identified 
for the following sources: (i) Quantis versus all other sources (Maple, Mathematica, 
Vienna, n); and (ii) Vienna versus Mathematica and Maple. 

4. For the test based on Shannon's information theory, as well as for the Solovay-Strassen 
test, no significant differences among the five chosen sources are detected. In the first 
case the reason may come from the fact that averages are the same for all samples. In 
the second case the reason may be due to the fact that the test is based solely on the 
behavior of algorithmic random strings and not on a specific property of randomness. 

We close with a cautious remark about the impossibility to formally or experimentally 
"prove absolute randomness." Any claim of randomness can only be secured relative to, and 
with respect to, a more or less large class of laws or behaviors, as it is impossible to inspect 
the hypothesis against an infinity of — and even less so all — conceivable laws. To rephrase 



a statement about computability 42j, p. 11], "how can we ever exclude the possibility of our 



presented, some day (perhaps by some extraterrestrial visitors), with a (perhaps extremely 
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complex) device that "computes" and "predicts" a certain type of hitherto "random" physical 
behavior?" 
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